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ABSTRACT 

Project HAITI STARS (now in its fourth year) was 
designed to provide Haitian-, Spanish-, and Chinese-speaking high 
school students of limited English proficiency (who scored at or 
below the 40th percentile on the Language Assessment Battery) i.. 
three schools in Brookljm and Queens, New York with instruction in 
the beginning through transitional levels of 

English-as-a-Second-Language (ESL) and native language arts (NLA) as 
well as bilingual instruction in the content areas. The project was 
also to offer computer science classes, personal and career guidance, 
curriculum and staff development, and parental involvement 
activities. Of the 413 students who enrolled in the project, 336 
participated in both semesters. The project was fully implemented and 
met its objectives for career counseling, staff and parental 
involvement, and NLA. The project also supplied data to evaluiite 
objectives for grade retentiorVref erral to special education or 
curriculum development. The project did not meet its objective for 
ESL nor did it provide data to evaluate objectives for gifted and 
talented programs and enrollment in postsecondary education 
institutions. Recommendations based on the projects* findings are 
included and data collection and analysis methods and instructional 
materials are appended. (JP) 
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FOREWORD 



The body of this report is preceded by an Extract which presents an overview of salient points of 
the project: fundioj cycle; eofoQment figures; background of students served; admission criteria; and 
programming features, strengths, and limitations, including the outcome of all objectives. The extract also 
presents the conclusions drawn by the Office of Research, Evaluation, and Assessment (OREA) about the 
program and its recommendations for program improvement. 

The extract is followed by the body of the report, titled Program Assessment . This includes such 
information as staffing, program implementation, and outcome and implementation objectives. 
Instructional objectives arc presented first, followed by noninsiructional objectives. The report then 
addresses those aspects of programming mandated by Title VII regulations that do not have speciOcally 
stated objectives. This may be information on attendance and dropout rate, grade retention, 
mains naming, referrals out of the program to meet special needs of the students, and withdrawals, A 
case history concludes the report. 

Data for this profile were collected and anal>-zed using a variety of procedures, which are 
described in A ppendix A following the text. 



Office of Research. Evaluation, and Assessment 
New York Ciiy Public Schools 

E.S.E.A. Title VII Evaluation Profile 

Higher Achievement and Improvement 
Through Instruction with Computers and Scholarly 
Transition and Resource Systems Program 
(Project HAITI STARS) 

Transitional Bilingual Education Grant T003A80178 

1991-92 

EXTRACT 

PROJECT DIRECTOR: Ms. JoeUe Dufresne FUNDING CYCLE: Year 4 of 5 

SITES 



School Borough Grade Levels Enrollment* 

(spring) 

Sheepshead Bay High School Brooklyn 9-12 120 123 

Andrew Jackson High School Queens 9-12 118 124 

Far Rockaway High School Queens 9-12 101 119 

*The project enrolled 413 students (21 fewer than in the previous year), 336 of whom participated both semesters. 
Male students numbered 181, female students 199; gender was not stated for 33. 

STUDENT BACKGROUND 

Native Language Number of Students Country of Origin Number of Students 

Haitian 136 Haiti 136 

Spanish 130 China 89 

Chinese 126 El Salvador 55 

Hindi 5 Hong Kong 31 

Other 7 Dominican Republic 26 

Unreported 9 Puerto Rico 20 

India 11 

Guatemala 10 

Honduras 6 

Other 23 

Unreported 6 



Median Years of Education in Native Country: 9.0; in the United States: 2.0 
Percentage of Students Elipbie for Free Lunch Pro-am: 89.3 



ADMISSION CRITERIA 

The project admitted students who scored at or below the 40th percentile on the Language Assessment 
Batteiy (LAB) and were recommended by the project's bilingual counselor. Teacher and parent requests were 
acknowledged Criterion-Referenced English Syntax Test (CREST) results were used for placement. 
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PROGRAMMING 



Desiyn Features 

Project HAITI STARS was designed to provide Haitian-, Spanish-, and Chinese-speaking students of 
limited English proQciency (LEP) with instruction in the beginning through transitional levels of English as a 
Second Language (E.S.L.) and Native Language Arts (N.L.A.) as well as bilingual instruction in the content areas. 
The project also was to offer computer science classes, personal and career guidance, curriculum and staff 
development, and parental invoK^ement activities. 

Capacity building. At the end of the project's Title VII funding, the three schools involved intend to 
continue the project. 



Strengths and Limitations 

Project HAITI STARS provided individual attention that allowed students to work at their own pace. 
Resource specialists at two sites reported that more staff was needed. 



CONCLUSIONS AND RECOMMENDATIONS 

Project HAITI STARS was fully implemented. As it had done last year, the project met its objectives for 
career counseling, staff development, and parental involvement. While it had not met the objective last year, this 
year the project met its objective for Native Language Arts (N.LA.). Last year Project HAITI STARS had not 
supplied data to evaluate objectives for grade retention/referral to special education or curriculum development; 
this year the project met objectives in those areas. The project met its objective for remedial programs. As it had 
done last year, the project partially met its objectives for content area subjects and dropout prevention. Last year 
it fully met its computer science instruction and attendance objectives; this year it partially met them. The project 
did not meet its objective for E.S.L. although it had met it last year. As had occurred last year, due to lack of 
sufficient data, OREA could not evaluate objectives for gifted and talented programs/enrollment in post-secondaty 
education institutions. While the project met its objective for staff awareness of pupil needs and problems last 
year, this year it did not provide the data to evaluate it. 

The conclusions, based on the findings of this evaluation, lead to the following recommendations: 

• Provide OREA with the necessary data to evaluate all objectives. 

• Explore ways of increasing the number of students who have increased their proficiency in English, 
possibly by offering more individualized instruction. 

• Intensify efforts to increase learning in the computer science course. 
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PROGRAM ASSESSMENT 



STAFFING 

Title VII Staff (Total 8) 



Title 


Degree 


Laneuaee Comoetencies 


Title VII Funding 


Other Funding 


Project Director 


M.S. 


Haitian, French 


Full time 




Resource Specialist 


M.S. 


Haitian, French 


Full time 




Guidance Counselor 


M.S. 


Spanish 


Part-time 


P,CE.N. 


Resource Specialist 


M.A. 


Chinese 


Full time 




Resource Teacher 


M.A. 


Chinese 


Full time 




Paraprofessional 


B.A. 


Chinese 


Full time 




Paraprofessional 


A.A. 


Spanish 


Full time 




Paraprofessional 


H.S. 


Haitian, French 


Full time 





Other Staff Working With Project Students (Total 26) 



Title 

Teacher 25 
Unreported 1 



Decrees 




Certification 




P.D. 


I 


E.S.L 


16 


Ph.D. 


1 


Spanish 


4 


M.A. 


17 


Other 


8 


M.S. 


I 


Unreported 


1 


B.A. 


5 






Unreported 


1 







Language Competencies and Teaching/ 
Learning Proficiencies (TP/CP^* 

Spanish TP 7 
French TP 1, CP 1 
Chinese TP 1 



IMPLEMENTATION AND OUTCOMES (Objectives prefaced by •) 
English as a Second Language (E,S.L.) 

E.S.L. CLASSES 

Mes Level Periods Weekly 







Fall 


Spring 


Far Rockaway High School 


Beginning 


10 


10 




Intermediate 


10 


10 




Advanced 


5 


5 




Transitional 


5 


5 


Andrew Jackson High School 


Beginning 


15 


15 




Intermediate 


10 


10 




Advanced 


10 


10 




Transitional 


10 


10 


Sheepshead Bay High School 


Beginning 


15 


14 




Intermediate 


15 


15 




Advanced 


10 


11 




Transitional 


10 


11 



♦Teaching Proficiency (TP): Competent to teach in this language. 
Communicative Proficiency (CP): Conversational capability only, 

o ' 
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Instructional teaching strategies included cooperative learning, staff tutoring, peer tutoring, and teacher-led 
classes using a text-interpretative approach. 

• Seventy-five percent of project students will demonstrate a significant improvement in English 
language proficiency. 

Evaluation Instrument: Language Assessment Battery (LAB)* 

Pretest: March 1991; posttest: March 1992. 

Number of students for whom pre- and posttest data were reported: 284 

Percent of students with pretest/posttest gains: 57.7 

Mean gain: 6.7 N.C.E.S (s,d.=9.4) 

Mean gain is statistically significant (r= 12.01, /7<,05). 

Project did not meet E.S.L. objective. 

Native Language Arts (N.L.A.'^ 

Students lacking literacy skills in native language (estimated): Spanish 15 percent, Chinese 10 percent, Haitian 75 
percent. 



High School 
Far Rockaway 

Andrew Jackson 
Sheepshead Bay 



N.L.A. ClASSnS 

Level 

Beginning 

Intermediate 

Advanced 

Advanced Placement 

Intermediate 

Intermediate 



Periods Weekly 

5 Spanish 
5 Spanish 
5 Spanish 
5 Spanish 

10 Haitian 

5 Chinese 



All N.LA. classes used computer software to l^uild vocabulary and to improve reading and writing skills in 
the native language. Teachers used group learning, peer tutoring, individualized training, and hands-on activities 
as N.L.A. instructional strategies. Teachers and paraprofcssionals offered afterschool tutoring, and parents were 
asked to reinforce study at home. 

Students in intermediate Haitian N.LA. read La Kobe tf( Le Couteau by Campbell and Bauer. The 
advanced class read Le Petit Prince by St. Exupery and /c> Jtfux Soni Fails by Jean Paul Sartre. 



*OREA used a gap reduction design to evaluate the effect of supplementary instruction on project students' 
performance on the LAB. Since all LEP students in New York City are entitled to such instruction, no valid 
comparison group exists among these students, and OREA used instead the group on which the LAB was normed. 
Test scores arc reported in Normal Curve Equivalents (N.C.E.s), which arc normalized standard scores with a 
mean of 50 and a standard deviation of 21.06. It is assumed that the norm group has a zero gain in N.C.E.S in the 
absence of supplementary instruction and that participating students* gains are attributable to project services. 



Students in beginning Spanish N.LA. used Galena Hispdnica by Adex Albini, and El cuento by Crow 
Dudley. Intermediate Spanish classes used Cuentitos simpdticos by Rubin Pfieffer. Advanced students read Del 
Solar Hispdnica by A. Del Rio. 

• Seventy-five percent of program students will achieve a passing grade of 65 or better in Haitian/French 
language arts. 

Evaluation Indicator: Onal course grades. 

PASSING GRADES IN NATIVE LANGUAGE ARTS 

Enrollment Percent Passing 

Language Fall Spring Fall Spring 

Haitian 47 59 89.4 86.4 

Project met objective for Haitian/French language arts. 



• Seventy-five percent of Spanish dominant students will demonstrate a significant increase in Spanish 
language achievement. 

Evaluation Indicator: final course grades. 

PASSING GRADES IN N^. . /£ LANGUAGE ARTS 

Enrollment Percent Passing 

La"g"^gg Fall Spring Fall Spring 

Spanish 80 89 92.5 93.3 

Project met objective for Spanish students in N.LA,, 

The project did not have an objective for Chinese N.LA. 



Content Area Subjects 

Project students took bilingual courses in mathematics, science, and social studies. Instructional strategics 
included the use of videos, cooperative learning, group discussion, and the traditional lecture approach. Teachers 
also used computers to build students' skills in all three content area subjects. Paraprofessionals were available lor 
individual assistance. Instructional materials are listed in Appendix B. 

• Seventy.five percent of all target students will achieve at least the passing grade of 65 or better m the 
subject areas of mathematics, social studies, and science. 

Evaluation Indicator: final course grades. 



IQ 





PASSING GRADES IN CONTENT AREA COURSES 

Fall 




High School 


Subject 


Enrollment 


Percent Passing 


Pnrollmf»nt 




Saeep^beaa Bay 


Mathematics 


96 


95.8 


100 


88.0 




Science 


94 


86.2 


93 






Social Studies 


101 


95.0 


114 




Andrew Jackson 


Mathematics 


42 


73.8 


43 


65.1 




Science 


49 


67.3 


60 


75.0 




Social Studies 


43 


83.7 


51 




Far Rockaway 


Mathematics 


96 


50-0 


115 


52.2 




Science 


84 


83.3 


97 


81.4 




Social Studies 


89 


88.8 


107 


89.7 



The objective was met in ail courses at Sheepshead Bay High School. At Andrew Jackson High School, 
the objective was met for social studies both semesters, and science in the spring but not in the fall. It did not 
meet the objective for mathematics although it came very close in the fall. At Far Rockaway High School, the 
objective was met for science and social studies in both semesters, but not for mathematics in either semester. 

Project partially met content area objective. 



Computer Science Instruction 

Computer resource centers were installed at all three sites and all had a good supply of software programs. 
The instructional materials used are listed in Appendix B. 

• Seventy-five percent of program students will show significant gains in computer science (Basic 
language and/or COBOL) and achieve a passing grade of 65 or better. 

Evaluation Indicator: final course grades. 

Twenty-five students enrolled in the fall semester, and 88 percent of these students passed; 23 enrolled in 
spring, and 73.9 percent of these students passed. 

Project met computer science objective during the fall semester and came very close to meeting it in 

spring. 



Career Counseling 

• All program students will meet the Guidance Counselor on an individual basis for advisement at least 
two times during the school year for career orientation and planning. 

Evaluation Indicator: program records. 

The project director reported that all program students met with the guidance counselor on an individual 
basis at least two times during the school year for career orientation and planning. 

Project met career counseling objective. 
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Other Activities 



The program held cultural and career- related field trips and career fairs. All three sites pubUshed a vearlv 
magazine. Far Rockaway High School also published a monthly bilingual project newsletter. 

Attendance 

• Program students' attendance rate wiU be 10 percent greater than mainstream students'. 
Evaluation Indicator: attendance records. 

ATTENDANCE RATES 
Hi g h School Project Students Mainstream Students Difference 

Sheepshead Bay 95,2 82 1 

Andrew Jackson 98.8 80 3 

Far Rockaway 89.7 82 8 

Project met attendance objective at two sites and came very close to meeting it ai the third. 

Dropout Prevention 

• The dropout rate of the students will be less than mainstream students. 
Evaluation Indicator: school records. 

DROPOUT RATES 

High School Project Students Mainstream Students Difference 



16.0' 
23.0 • 
8.3* 



Sheepshead Bay o.O 4.1 

Andrew Jackson 0.7 5*0 

Far Rockaway 12.9 5 9 



.4.1 
-4.3 
7 ^ 



Although the dropout rate at Far Rockaway High School decreased 15.4 percent from the previous vcar it 
contmued to be much higher than the mainstream rate, which allowed Project HAITI STARS to only pariialiv 
meet the objective. ' * 

Project partially met objective for dropout prevention. 



Student Grade Retenti on/Placement in Special Education Classes 

Students considered in need of special education were referred by their teachers to the School-based 
Support Team (S.B.SX) for interviewing and testing. The S.B.S.T. at one of the sites had a team member whi) 
spoke the project students* native language. At the two other sites, the resource spe iaUsts spoke the project 
students' native languages and were available to assist in evaluations. The team considered numerous factors s^hen 
evaluating a student, including background, attitude, and test results. 

• Students* grade retention and referral to or placement in special education classes rate will be 10 
percent less than mainstream students. 

Evaluation Indicator: school records. 
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PROJECT STUDENTS' RATES 



High School Grade Retention R eferral to Special Education 

Sfaeepshead Bay 0.8 0.0 

Andrew Jackson 0.0 0.0 

Far Rockaway 0.0 0.0 

As in the previous year, project did not provide mainstream figures. However, the zero referral rates 
could not be improved upon and the grade retention rate for Sheepshead Bay High School was lower than the 
usual school retention rate and far lower than last year's 21.8 percent. 

Project met grade retention/special education objective. 



Gifted and Talented Programs/Enrollment in Post-Secondary Education Institutions 

• Placement in programs for the gifted and talented and enrollment in post-secondary education 
institutions will be 10 percent greater than that of mainstream students. 

Evaluation Indicator: school records. 

The project did not refer any students to gifted and talented programs nor were any mainstream figures 
submitted to OREA for assessment. This was true in the previous year also. 

OR£A could not evaluate objective for referral to gifted and talented programs/enrollment in post- 
secondary education institutions. 



Remedial Programs 

• The rale of referral to special programs, e.g., P.C.E.N. remedial programs, will be 10 percent less than 
mainstream students. 

Evaluation Indicator: school records. 

The project did not refer any students to remedial programs nor were any data submitted for mainstream 
students. However, the zero referral rated could not be improved upon. 

Project, met remedial programs objective. 

Mainstreaming 

Project HAITI STARS mainstreamed two students (0.5 percent of participants), one student less than in 
the previous year. 



Academic achievement of former project students in mainstream. Data were not submitted on any former 
program participants. 
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Staff Develooment 



• Ninety percent of program staff will demonstrate professional growth by passing and completing 
courses of study and by attending in-service training sessions. 



Evaluation Indicator: program records. 



The project director reported that 90 percent of all program staff compJeied courses of stud^^an(i^ttended 
in-service training sessions. ' . . i ^ 



Project met staff development objective. 



Staff Awareness of Pupil Needs and Problems ^' 

• Eighty-five percent of staff will show an increase in awareness of pupil needs and pupil problems. 
Evaluation Instrument: OREA-developed 5-point Likert scale. 

The project did not provide this data, although it met this objective in the previous year. 
OR£4 could not assess objective for staff awareness of pupil needs and problems. 

Curriculum Development 

» Four instructional guides in the areas of mathematics, science, social studies, native language arts, and 
computer science in the native language will be developed. 

• The curriculum specialists will develop four additional interdisciplinary subject matter curriculum 
guides for teaching science and social studies in the native language. 

Evaluation Indicator: program inventory. 

Instructional guides for mathematics, science, social studies, native language arts, and computer science 
were developed. Curriculum specialists were hired to develop additional interdisciplinary curriculum guides for 
teaching science and social studies in the native languages of the students. 

Project met both curriculum development objectives. 
Parental Involvemen t 

AU three schools had a bilingual Parents Advison/Committee (PAC), and parents were heavily involved in 
meetings, open school days, classroom visits, and bilingua^conferences. 

• Program students' parents will demonstrai.c 10 percent more involvement than parents of mainstream 
students. ^ , 

Evaluation Indicator: project records. , * 

Attendance of program parents at parent aclivitics.was over 10 percent higher than was the attendance of 
mainstream parents at all three sites. [ 

Project met parental involvement objective* 

CASE HISTORY 

Project did not provide a case history. 
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APPENDIX A 



DATA COLLECTION AND ANALYSIS 



COLLECTION 

OREA evaluation coasuitanls visit sites and interview key personnel. The project director gathers 
data and, with the consuhant, completes forms (as shown below) as necessary. 

Student Data Form 

This one-page form is filled out by staff for each participating and mainstreamed student. OREA 
gathers data from this form on backgrounds, demographics, academic outcomes, attendance, referrals, and 
exit from the program. 

Project Director's Questionnaire 

The Project Director's Questionnaire includes questions on staff qualifications, program 
implementation, periods of instruction, and instructional materials and techniques. 

Project Director's Interview 

The interview gathers information on program and student or staff characteristics not supplied by 
the Project Director's Questionnaire. The interview also allows project staff to offer qualitative data or 
amplify responses to the questionnaire. 

Citvwide Test Scores 

OREA retrieves scores centrally from the Language Assessment Battery (LAB) and other 
citywide tests. For evaluation purposes, these test scores are reported in Normal Curve Equivalents 
(N.CE.s). N.CE.s are normalized standard scores with a mean of SO and a standard deviation (s.d.) of 
2L06. They constitute an equal-interval scale in which the distance is the same between any two adjacent 
scores. A gain of S N.CE.S is the same whether it is at the lower or the higher end of the scale. N.CE.s 
can be used in arithmetic computations to indicate group progress. (Percentile scales, although more 
familiar to many, are unsuitable for such computations since they are not equal-interval.) 

Likcrt-Tvpe Surveys 

Likert-type surveys, in which respondents mark their opinions on a scale from one to five, are 
used in a variety of ways. They examine student attitudes (i.e., toward school and career, native language 
use, and native and mainstream cuhures). They also assess staff and parent attitude and reactions to 
workshops and Qlher activities. 

ANALYSIS 

Gap Reduction Evaluation Design 

OREA uses a gap reduction design for measuring changes in standardized tests. Since no 
appropriate non-project comparison group is available in New York City, where all studenu of limited 
Englidi proficiency (LEP) are entitled to receive supplementary services, OREA compares the progress of 
participating students with that of the group on which the test was normed. !t is assumed that the norm 
group would show a zero gain in the absence of instruction, and gains made by project students could be 

/5 



attributed to project services. Scores are reported in Normal Curve Equivalents (N.CE.S). which are 
Qormatized standard scores with a mean of SO and a standard deviation of 21.06. (See ''Citywide Test 
Scores* above.) 



To test whether pre/posttest gains are greater than could be expected by chance alone, OREA 
uses a r-test. To test whether a difference between two proportions (e.g., program and mainstream 
attendance rates) is greater than could be expected by chance, OREA uses a z-test and reports the 
differences between the two proportions. The level of significance is set at .05 for all tests. 

Techniques For Minimizing Error 

The evaluation procedures minimize error by providing for proper administration of evaluation 
instruments through a combination of testing at i2-month intervals, appropriate analysis procedures 
and reporting. 

Instruments of measurement include the LAB (see above), the Degrees of Reading Power 
(D.R.P.) test, the Metropolitan Achievement Test-Mathematics (MAT-Math), El Examen de Lectura en 
Espanol (ELE), Likert-type scales (see above), and project-developed tests. Except for Likert scales and 
project-developed tests, these instruments are scored on a citywide basis at the Scan Center of the New 
York City Public Schools. 
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APPENDIX B 
INSTRUCTIONAL MATERIALS 



Apple lie and Tandy 1000 Computers 

Franklin Computers (speaking dictionary companion) 

Typewriters, video and audio cassette recorders 

Newbury House and Co. 
Regents 

Prentice Hall, Regents 



Grammar in Action 
English Step by Step 
Great American Story 
Real Stones 



Chinese Language Arts (vol. Ill) 
Galena Hispdnica 
El Cuento 

Aventuras de Don Quijote 
La Robe et le Couteau 
Les Jeux Sont Fails 



Lesley College 
McGraw-Hill Book Co. 
Holt, Rinehart & Winston 
Princeton University Press 



Content Areas 



Integrated Mathen^atics 
Repaso matemdtico 

Achieving Competence in Mathematics 
BioioQ^ 

Chinese Supplementary Text for Biology 
Introduccion a las Ciencias Bioldgicas 
Physical Science 

China (History, Culture, People) 
Exploring World History 
Comprende tu Mundo 
Historia de los E.E.UM, 



Dresler & Keenan 
Allyn and Bacon Inc. 
Amsco 

Allyn & Bacon 
Seward Park High School 
M. Fernandez & Cia 
Prentice Hal! 
Globe Book Co. Inc. 
Globe Book Co. Inc. 
Jarret Publishing 
Minerva Books, Ltd 
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